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The invention relates to the correction of defects in image sensors, and is 
applicable to digital signal processors, digital still cameras and to digital video cameras. It has 
particular relevance to image sensors for consumer electronics and for medical systems and is 
suitable for incorporation in a digital signal processor. 

Defects in images can take the form of single pixels, clusters or columns which 
have a small sensitivity difference compared to the rest of the image. A defect pixel may have 
a higher or a lower output signal than its neighboring pixels at the same illustration. This can 
be caused by defects in the sensor itself or by defects on the cover class of the image sensor 
that arise because the pixels around the edges of a sensor block will generally have lower 
sensitivity. In case of a big sensor, this sensor has to be built up out of different blocks. The 
signals from these blocks are stitched together. At the borders of these blocks the sensors have 
a slightly different sensitivity than the neighboring pixels. This results in a so-called stitch 
line, which often appears as a visible line dividing the image. For example, in a known image 
sensor, a stitch line may appear as a double column with a gain difference above 1% and 
frequently up to 3%. 

EP 0 519 719 describes a method of reducing edge defects in images generated 
using arrays of pick-up elements. An image splitter is employed to separate the images 
corresponding to adjacent elements in the array so as to reduce the edge effects. 

Defect correction can be accomplished by a correction that uses a (suitably 
weighted) average value of neighboring pixels that are not defect, the so-called average 
correction technique that is known to skilled persons in this technical field. However, the 
performance of the average correction technique is not good enough to completely eliminate 
the wide range of possible defects, including stitch lines and clusters, over a wide range of 
circumstances. 

It is, inter alia, an object of the invention to improve defect correction in image 
sensors. To this end, the invention provides a defect correction as defined in the independent 
claims. Advantageous embodiments are defined in the dependent claims. 
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According to one embodiment of the invention, if the severity of the defect is 
large then average correction is used. If the severity is small, then the defect pixel value is not 
corrected. For in-between values, the level of good nearby pixels is assessed and the defect 
pixel value is not corrected for relatively small level differences, while the average correction 
5 is used for relatively large differences. 

These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments described hereinafter. 
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In the drawings: 

10 Fig. 1 is a block flow diagram schematically illustrating one embodiment of a 

method according to the present invention; 

Fig. 2 schematically illustrates one stage of the method of Fig. 1; 

Fig. 3 schematically illustrates one example applied to another stage of the 
method of Fig. 1; and 

15 Fig. 4 schematically illustrates another example applied to the stage of Fig. 3. 

In Fig. 1 various stages of one embodiment of the method of the invention are 
shown. Level signal LI, level signal L2 and calibration information CD3 are determined in 
dependence upon the application concerned and the customer requirements. Digital Image 

20 data from a sensor S4 is supplied and pixel sampling is effected at sampler 5. At least two and 
preferably three pixels are sampled on each side of a defect. Differences between the 
intensities of the pixels are then calculated at difference calculator 6. Four difference values 
Dl, D2, D3, D4 are calculated; two different values Dl, D2 generated by differences in 
intensity across the defect and a difference value D3, D4 relating to each side of the defect. 

25 The difference signals Dl , D2, D3, D4 are then compared at comparator 7 to 

the level signals LI and L2. If any one of the difference signals is higher than its respective 
level signal then the image scene is categorized as "high frequency" (AC), but if all difference 
signals are lower than the two level signals then the image scene is categorized "low 
frequency" (DC). This is termed the "DC Test". 

30 When all the difference signals are lower than the level signals LI and L2, and 

the "DC test" results in low frequency (DC), this is considered an even image, and the average 
correction technique is employed by averager 8 on the image. 

When the DC test results in high frequency (AC) then the size (severity) of the 
defect is assessed at evaluator 9. If the defect is large (L) for example, no output signal = dead 
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pixel, then the average correction technique (8) is again followed. If the size of the defect is 
medium (M) then the intensity level of close or adjacent (nearby) good pixels is assessed at 
assessor 10 and, depending upon their value either the average correction technique (8) is used 
or the defect is not corrected (11). So, if the size of the defect is small (S) then no correction is 
5 applied to the defect pixel value in step 1 1 . 

While a block diagram is shown, each block following the image sensor S4 may 
be seen as a method step carried out by an image processor in a software implementation. 
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Fig. 2 schematically illustrates the calculated difference values. Pixels are 
10 labeled as a, b, c on one side of a defect cluster DEF and x, y, z on the opposite side. In this 
example the cluster DEF comprises two pixels m, n. The following differences are calculated: 



Dl 


: c-y 


D2 


: b-x 


D3 


: a - c 


D4 


: x - z 



Thus Dl and D2 represent differences between pixels on opposite sides of the 
defect cluster DEF whereas D3 and D4 represent the differences between pixels which lie on 
respectively the same sides of the defect DEF. 

20 Fig. 3 shows one particular example applied to the method of the invention. The 

intensities of the pixels a, b, c and x, y, z are represented by the bar graph and the differences 
Dl to D4 are illustrated by the respective arrows which are reproduced in the lower graph 
which also shows the values of level 1 and level 2 for comparison. In this example D3 and D4 
are above level 2 and thus this image is treated for correction as a "high frequency" (AC) 

25 image. The size of the defect is then assessed. If the size of the defect is large then the average 
correction technique is applied. If the defect is small then no correction is done. If the defect 
is of medium size then the intensity level of good adjacent pixels is assessed and either the 
average correction is used or the defect pixel value is not corrected as explained above. 

30 In Fig. 4 a more even image is used and the frequency is lower. All of the 

difference signals Dl, D2, D3 and D4 are below level 2. This will be treated as low frequency 
(DC), i.e. since it is a relatively even image, and correction will be by way of the average 
correction technique. 
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This correction method gives a good correction capability across a wide range 
of defects and defect sizes and can substantially reduce or eliminate the small defect lines 
hitherto seen. 

Typical results of the method of the invention are achieved on images of a 
checkered shirt. This is a high frequency (AC) image and a stitch line tends to be very obvious 
in such scenes: a 3% small defect column would be typical. When the average correction 
technique is used, the small defect lines are still very evident. When the method of the 
invention is used and level correction (small) is applied with for superior results: the small 
defect line is barely visible. 

In a second example, the method of the invention is applied to a scene with 
cluster defects. A raster of 24% clusters C in the air and in the grill of a classic car is present in 
the original image. It appeared that the cluster defects in the image, particularly in the grill, are 
substantially reduced by means of the level correction method according to the invention, thus 
illustrating that the method of the invention can correct rather large clusters which previous 
technologies could not. 

Generally, the levels at which defects are categorized as large, medium or small 
is determined during calibration of the device in production. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of elements or steps other than those listed 
in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements, and by means of a suitably programmed computer. In the 
device claim enumerating several means, several of these means can be embodied by one and 
the same item of hardware. The mere fact that certain measures are recited in mutually 
different dependent claims does not indicate that a combination of these measures cannot be 
used to advantage. 
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L A method of correcting defects in image data comprising an array of pixels, the 

method comprising: 

sampling (5) the intensity of pixels of the image data in each side of a defect; 

calculating (6) differences between the sampled intensities to generate one or 
more intensity difference signals (Dl, D2) indicative of intensity differences across the defect; 
and 

correcting (7-11) the defect in dependence on the intensity difference signals 

(D1,D2). 

2. A method as claimed in claim 1 , further comprising the step of: 
calculating (6) differences between the sampled intensities to generate one or 

more further intensity difference signals (D3, D4) indicative of an intensity difference on each 
respective side of the defect, to correct (7-11) the defect in dependence on the further intensity 
difference signals. 

3. A method as claimed in claim 1, further comprising the steps of: 
comparing (7) the intensity difference signals (D1-D4) with a predetermined 

level value (LI, L2) to generate (7) a first control signal (AC) if any one of the intensity 
difference signals (D1-D4) is above the predetermined level value (LI, L2), and a second 
control signal (DC) if all of the intensity difference signals are below the predetermined level 
value (LI, L2). 

4. A method according to claim 2 wherein the sampling step (5) comprises 
sampling the intensity of three pixels on each side of the defect, and wherein the calculating 
step (6) comprises two intensity difference signals (Dl, D2) across a defect, and one intensity 
difference signal (D3, D4) at each side of the defect. 

5. A method according to claim 1 wherein the predetermined level value (LI, L2) 
is determined by calibration of the apparatus for which the method is used. 
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6. A method according to claim 1, wherein the predetermined level signal (LI, L2) 

comprises a first level signal (LI) and a second level signal (L2). 

5 7. A method according to claim 3, comprising employing average correction 

techniques (8) if the second control signal (DC) is generated. 

8. A method according to claim 3 comprising the additional step of assessing (9) 
the severity of the defect if the first control signal (AC) is generated. 

10 

9. A method according to claim 8 comprising employing average correction 
techniques (8) if the first control signal (AC) is generated and the severity of the defect is large 
(L). 

15 10. A method according to claim 8 comprising employing no defect pixel value 

correction if the severity of the defect is small (S). 

11. A method according to claim 8, further comprising the step of assessing (10) 
the level of good nearby pixels in the event that the defect severity is medium (M). 

20 

12. A method according to claim 1 1 wherein no defect pixel value correction (1 1) is 
employed if the level of the good nearby pixels is relatively small (NS). 

13. A method according to claim 11, wherein average correction techniques (8) are 
25 employed if the level of the good nearby pixels is relatively large (NL). 

14. Apparatus for correcting defects in image data comprising an array of pixels, 
the apparatus comprising: 

means (5) for sampling the intensity of pixels of the image data in each side of 

30 the defect; 

means (6) for calculating differences between the sampled intensities to 
generate one or more intensity difference signals (Dl, D2) indicative of intensity differences 
across the defect; and 
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means (7-11) for correcting the defect in dependence on the intensity difference 
signals (Dl, D2). 

15. A camera, comprising: 

5 an image sensor (S4) for furnishing image data; and 

an apparatus for correcting defects in the image data as claimed in claim 14. 
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In a method of correcting defects in image data comprising an array of pixels, 



the intensity of pixels of the image data in each side of the defect is sampled (5), differences 
between the samples intensities are calculated (6) to generate one or more intensity difference 
signals (Dl, D2) indicative of intensity differences across the defect, and the defect is 
5 corrected (7-11) in dependence on the intensity difference signals (Dl, D2). Preferably, 

depending on the intensity difference signals (Dl, D2) either an average correction technique 
or no defect pixel correction is used. 
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